Generative shape creation and editing

ABSTRACT

Generative shape creation and editing is leveraged in a digital medium environment. An object editor system represents a set of training shapes as sets of visual elements known as “handles,” and converts sets of handles into signed distance field (SDF) representations. A handle processor model is then trained using the SDF representations to enable the handle processor model to generate new shapes that reflect salient visual features of the training shapes. The trained handle processor model, for instance, generates new sets of handles based on salient visual features learned from the training handle set. Thus, utilizing the described techniques, accurate characterizations of a set of shapes can be learned and used to generate new shapes. Further, generated shapes can be edited and transformed in different ways.

RELATED APPLICATION

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 16/744,105 filed on 15 Jan. 2020 and titled“Generative Shape Creation and Editing,” the entire disclosure of whichis hereby incorporated by reference in its entirety herein.

BACKGROUND

Graphics editing systems are implemented to generate and edit visualobjects, such as digital photographs, digital objects, animations, andso forth. Accordingly, some graphics editing systems enable visualobject editing by representing complex shapes using compact and editablerepresentations like cages, skeletons, primitives, curves and so on.While there are exist solutions for extracting such representations fromexisting shapes, learning a generative model for such representationsfor creating new shapes or editing existing shapes presents someparticular challenges. Recent implementations have utilized deepgenerative models to learn distributions of “raw” shape representationslike occupancy grids, point clouds, and meshes. However, suchrepresentations are typically not amenable to editing procedures and donot explicitly capture the structure of a shape.

Thus, while conventional graphics editing systems may provide ways tolearn and represent shapes as part of visual object editing, such shapesare not easily edited and may misrepresent shape structure. As a result,shape editing using conventional graphics editing systems can beburdensome not only from a user perspective, but also on systemresources. For instance, shapes generated by such systems may beinaccurate and thus force users to engage in numerous interactions withsuch systems to attempt to generate and edit a desired shape. Further,the limited ability to apply edits to a generated shape furtherexacerbates this problem. This not only presents an undesirable userexperience, but wastes system resources (e.g., processor bandwidth,memory, network bandwidth, and so forth) utilized to respond to andapply user edits.

SUMMARY

Generative shape creation and editing is leveraged in a digital mediumenvironment. For instance, to mitigate the challenge of inaccuracies andmischaracterization of shape structure experienced in typical graphicsediting systems, the described object editor system represents a set oftraining shapes as sets of visual elements known as “handles,” andconverts sets of handles into signed distance field (SDF)representations. A handle processor model is then trained using the SDFrepresentations to enable the handle processor model to generate newshapes that reflect salient visual features of the training shapes. Thetrained handle processor model, for instance, generates new sets ofhandles based on salient visual features learned from the traininghandle set. Thus, utilizing the described techniques, accuratecharacterizations of a set of shapes can be learned and used to generatenew shapes. Further, generated shapes can be edited and transformed indifferent ways.

This Summary introduces a selection of concepts in a simplified formthat are further described below in the Detailed Description. As such,this Summary is not intended to identify essential features of theclaimed subject matter, nor is it intended to be used as an aid indetermining the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanyingfigures.

FIG. 1 is an illustration of an environment in an example implementationthat is operable to employ techniques described herein.

FIG. 2 depicts an example system that represents an overview ofprocesses for generative shape creation and editing.

FIG. 3 a depicts an example system that describes example detailsrelated to training and utilization of a handle processor model.

FIG. 3 b depicts a system for incorporating handle accuracy predictioninto a handle processor model

FIG. 4 depicts an example system for generating handle signed distancefields.

FIG. 5 depicts a system describing example aspects of generating signeddistance fields based on handle parameters.

FIG. 6 depicts an example system for shape generation.

FIG. 7 depicts an example system for generating shapes viainterpolation.

FIG. 8 depicts an example system for generating shapes via shapecompletion.

FIG. 9 depicts an example system for generating shapes of differentcomplexity via shape completion.

FIG. 10 depicts an example system for generating shapes of withdifferent handle types.

FIG. 11 depicts an example procedure for generating shapes.

FIG. 12 depicts an example procedure for shape completion.

FIG. 13 depicts an example procedure for shape editing.

FIG. 14 illustrates an example system including various components of anexample device that can be implemented as any type of computing deviceas described and/or utilized with reference to FIGS. 1-13 to implementaspects of the techniques described herein.

DETAILED DESCRIPTION

Overview

To overcome the challenges to shape creation and editing presented intypical graphics editing systems, generative shape creation and editingis leveraged in a digital medium environment. For instance, to mitigatethe challenge of inaccuracies and mischaracterization of shape structureexperienced in typical graphics editing systems, the described objecteditor system represents a set of training shapes as sets of visualelements known as “handles,” and converts sets of handles into signeddistance field (SDF) representations. A handle processor model is thentrained using the SDF representations to enable the handle processormodel to generate new shapes that reflect salient visual features of thetraining shapes. The trained handle processor model, for instance,generates new sets of handles based on salient visual features learnedfrom the training handle set. Thus, utilizing the described techniques,accurate characterizations of a set of shapes can be learned and used togenerate new shapes. Further, generated shapes can be edited andtransformed in different ways.

For instance, consider a scenario where a user selects a set of shapes,such as by selecting a pre-generated set of shapes. Each shape of theset of shapes is represented as a set of handles that each have aparticular set of handle parameters. The handle parameters describegeometric attributes of each handle, such as handle size, handle centerlocation, handle rotation, and so forth, relative to a respective shape.Each handle is then converted into an SDF representation by applying asigned distance function to handle parameters in a coarse regular grid.Generally, utilizing SDF representations of handle parameters providesfor a more consistent shape representation than simple parametricrepresentations. For instance, consider an example where a particularhandle is a cuboid. In this example, there are multiple configurations(e.g., rotation values, scale values, and translation values) thatdescribe the same object. However, an SDF representation will be thesame regardless of the original handle parameters. This provides formore accuracy than conventional shape editing techniques, and makestraining a model for shape generation significantly easier.

The SDF representations are then utilized to train an encoder of thehandle processor model to generate a latent representation of theoriginal shapes. In at least one implementation, the handle processormodel represents a variational autoencoder (VAE) trained to reconstructthe input set of handles to generate the latent representation.Generally, the latent representation represents salient features of theoriginal shapes in SDF form. A decoder of the handle processor modelthen decodes the latent representation to generate parametricrepresentations of output shape handles that can be used for shapegeneration and editing. For instance, after the handle processor modelis trained using SDF representations of training shapes, the modeloutputs parametric representations of new handle sets that can each beused to generate a new shape based on features represented in the latentrepresentation. As further described below, different shape generationand editing tasks can be performed via manipulation of the latentrepresentation, such as shape sampling, shape interpolation, shapecompletion, and so forth.

The described techniques further enable handle sets of differentcomplexity to be generated, and for inaccurately predicted handles to beremoved prior to generating a new shape. For instance, the handleprocessor model leverages a second decoder branch to predict an accuracyprobability for each handle represented in the latent representation.Handle representations that do not meet an accuracy probabilitythreshold can be removed prior to final shape generation, thus enablingmore accurate representations of salient shape geometries learned froman original input set of shape handles.

Additionally, the described techniques support shape editing usingmultiple types of handles, such as handles that represent multipledifferent types of geometric primitives. For instance, individualhandles in sets of handles that are input to the handle processor modelare labeled with a handle type, such as “cuboid,” “ellipsoid,” and soforth. A loss function utilized by the handle processor model includes a“handle type” term that matches generated handle types with known handletypes from the set of labeled handles. Generally, this enables moreaccurate representation and editing of handles generated by the model.

Accordingly, techniques for generative shape creation and editingovercome the deficiencies of traditional ways for shape generation andediting. For instance, by using SDF representations of visual elementsthat make up shapes, more accurate shape features can be learned andcharacterized than is provided by conventional systems. Further, byutilizing a separate decoder branch for accuracy prediction,inaccurately predicted handles can be filtered out to enable moreaccurate shape generation. In this way, accurate shape characterizationand generation provided by the described techniques can be leveraged toreduce inaccuracies and resource wastage experienced in conventionalgraphics editing systems.

Term Descriptions

These term descriptions are provided for purposes of example only andare not intended to be construed as limiting on the scope of the claims.

As used herein, the term “shape” refers to a digital visual object withvarious visual and geometric attributes, such as size and orientation.Generally, a shape may be generated in various ways, such as based on avisual object taken from a digital photograph, a visual object createdvia an image editing system, a visual objected generated by anartificial intelligence technique, and so forth.

As used herein, the term “handle” refers to a visual element that makesup a portion of a shape. A handle, for instance, represents a visualstructure with particular geometric and spatial attributes thatcontribute to the appearance of a shape. For example, an instance ofshape is made up of a collection of handles that combine to give theshape its visual appearance and logical representation. Further, aparticular handle can be described with reference to its visualparameters, such as size, orientation, distance from other handles,distance from a center and/or boundary of an image, and so forth.

As used herein, the term “signed distance field” (“SDF”) refers to adata representation of a visual element (e.g., a handle) derived bymapping distances between points of a visual element. For instance, anSDF for a visual element can be generated by taking each pixel of thevisual element and mapping a distance between the pixel and a particularpoint in the visual element, such as a boundary pixel for the visualelement. In at least one implementation, an SDF for a visual element byapplying a signed distance function to the visual element in a coarsegrid, such as a grid with 8³ cells.

As used herein, the term “latent representation” represents data that isgenerated by an encoder based on input shapes (e.g., a set of trainingshapes), and that is decoded by a decoder to generate shapes, e.g., aset of new shapes. An encoder, for instance, represents a neural networkthat takes SDF representations of a set of handles and encodes a latentrepresentation z that represents a compressed version of the input SDFrepresentations. A decoder then takes the latent representation anddecodes the latent representation to generate parameterized handles thatattempt to reconstruct a set of training handles used to generate thelatent representation. The parameterized handles can be used, forinstance, to generate a new set of shapes.

As used herein, the term “generated shape” refers to a shape (e.g., anew collection of handles) that is generated based on a set of trainingshapes. A generated shape, for instance, is generated using a set ofhandles generated from a decoded latent representation. As furtherdescribed below, a generated shape can be generated by applyingdifferent operations to a latent representation, such as sampling,interpolation, shape completion, and so forth.

In the following discussion, an example environment is first describedthat may employ the techniques described herein. Example systems andprocedures are then described which may be performed in the exampleenvironment as well as other environments. Performance of the exampleprocedures is not limited to the example environment and the exampleenvironment is not limited to performance of the example procedures.Finally, an example system and device are described that arerepresentative of one or more computing systems and/or devices that mayimplement the various techniques described herein.

Example Environment

FIG. 1 is an illustration of an environment 100 in an exampleimplementation that is operable to employ generative shape creation andediting as described herein. The illustrated environment 100 includes anobject editor system 102 and a client device 104 that arecommunicatively coupled, one to another, via a network 106.

Computing devices that are usable to implement the object editor system102 and the client device 104 may be configured in a variety of ways. Acomputing device, for instance, may be configured as a desktop computer,a laptop computer, a mobile device (e.g., assuming a handheldconfiguration such as a tablet or mobile phone), and so forth. Thus, thecomputing device may range from full resource devices with substantialmemory and processor resources (e.g., personal computers, game consoles)to a low-resource device with limited memory and/or processing resources(e.g., mobile devices). Additionally, a computing device may berepresentative of a plurality of different devices, such as multipleservers utilized by a business to perform operations “over the cloud” asfurther described in relation to FIG. 14 .

The object editor system 102 includes a visual object editor module 108that is representative of functionality to process sets of handles thatdefine different shapes and to enable shape-related tasks to beperformed further to techniques for generative shape creation andediting described herein. Accordingly, the object editor module 108leverages a handle processor model 110 that implements machine learningtechniques to learn characteristics of shapes made of sets of handles,and to enable the characteristics to be leveraged to enable variousshape-related tasks, such as shape creation, completion, and editing.Further, the object editor system 102 maintains training data 112 storedon a storage 114 and that can be leveraged to train the handle processormodel 110 to perform that described tasks.

The training data 112 includes training shapes 116 that are each made upof training handle sets 118. The training shapes 116, for instance,represent a training data set of different visual objects, such asvisual objects derived from digital drawings, digital photographs,digitized versions of analog images, and so forth. The training handlesets 118 represent sets of handles that each make up a respectivetraining shape 116. Generally, a handle refers to a visual element thatcan be utilized to represent a portion of a shape. Thus, each traininghandle set 118 can represent a set of visual elements that combine toform a respective training shape 116. In at least some implementations,individual handles in the training handle sets 118 are tagged ashandles, and may further be tagged as specific handle types. Forinstance, handles may be implemented as different geometric shapes(e.g., geometric primitives), and handles within the training handlesets 118 may be tagged as particular instances of geometric shapes.Thus, the training handle sets 118 include training labels 120 thatlabel individual handles of the training handle sets 118 based on theirrespective type of geometric shape.

The object editor system 102 further includes shape data 122 stored onthe storage 114. Generally, the shape data 122 represents data that canbe utilized by and result from operation of the object editor module108. The shape data 122 includes generated shapes 124, which includegenerated handle sets 126 and generated labels 128. The generated shapes124 represent different outputs from the handle processor model 110,such as shapes that are generated, edited, and so forth, by the handleprocessor model 110. The generated handle sets 126 represent sets ofhandles that are generated based on output from the handle processormodel 110 to create the generated shapes 124. The generated labels 128represent labels that can be applied to individual handles of thegenerated handle sets 126. For instance, as mentioned above, handles maybe implemented as different handle types, e.g., based on differentgeometric shapes. Accordingly, the generated labels 128 can identifyhandle types for individual instances of handles in the generated handlesets 126.

Further to the environment 100, the object editor module 108 includes aneditor graphical user interface (GUI) 130 that is configured to enableuser interaction with the object editor system 102. The editor GUI 130,for instance, is output via a display device 132 of the client device104, and a user can interact with the object editor system 102 viainteraction with the editor GUI 130. Further, output from the objecteditor module 108 can be displayed via the editor GUI 130 on the displaydevice 132.

Having considered an example environment, consider now a discussion ofsome example details of the techniques for generative shape creation andediting in a digital medium environment in accordance with one or moreimplementations.

Implementation Details

FIG. 2 depicts an example system 200 that represents an overview ofprocesses for generative shape creation and editing in accordance withvarious implementations. More detailed discussions of individual aspectsof the system 200 are presented after discussion of the system 200. Inthe system 200, the handle processor model 110 takes the training shapes116 including the training handle sets 118 as input, processes thetraining shapes 116, and outputs the generated shapes 124. As mentionedabove, the generated shapes 124 are composed of generated handle sets126.

In at least some implementations, the generated shapes 124 are generatedin response to user interaction with the editor GUI 130. For instance, auser provides user input 202 to the editor GUI 130 instructing theobject editor module 108 to perform a shape task such as shape creation,shape completion, and/or shape editing. Accordingly, based on the userinput 202, the object editor module 108 generates shape instructions 204that describe a shape task and/or set of shape tasks to be performed.Thus, the generated shapes 124 may represent generated shapes, completedshapes, and/or edited shapes that are generated utilizing processingperformed by the handle processor model 110. Further details of suchprocessing are now discussed.

FIG. 3 a depicts an example system 300 a that describes example detailsrelated to training and utilization of the handle processor model 110,such as overviewed in the system 200. In the system 300 a, a set oftraining handle sets 118 are converted into handle signed distancefields (SDFs) 302. Generally, each handle SDF 302 includes datadescribing a derived representation of a respective training handle fromthe training handle sets 118. Further details concerning generation ofthe handle SDFs 302 are discussed below. The handle SDFs 302 are inputto an encoder module 304 of the handle processor model 110, whichencodes the handle SDFs 302 to generate a latent representation 306 ofthe training handle sets 118. Generally, the latent representation 306represents a manifold (e.g., a topological space) that describesdifferent handle configurations. In at least one implementation, thehandle processor model 110 is implemented as a variationalauto-autoencoder (VAE) trained to reconstruct the training handle sets118. Accordingly, the encoder module 304 can be implemented as a stackof fully connected layers (e.g., using batch normalization and RectifiedLinear Unit (ReLU) activations) which independently processes eachhandle represented in the handle SDFs 302. The result of this processingis then aggregated through max-pooling and followed by another fullyconnected layer to generate the latent representation 306. Generally,the latent representation 306 represents salient characteristics of thetraining handle sets 118 derived from the encoder module 304 processingthe handle SDFs 302.

Further to the system 300 a, a decoder module 308 of the handleprocessor model 110 decodes the latent representation 306 to generatethe generated handle sets 126. The generated handle sets 126, forinstance, are parametric representations of the generated handle sets126 that can be utilized to generate the generated shapes 124. In atleast one implementation, the decoder module 308 is a stack of fullyconnected layers (e.g., using batch normalization and ReLU activations)that produces a parametric representation for n number of shape handles.As further described below, the number of generated handles in each ofthe generated handle sets 126 can be changed according to the complexityof the original dataset, e.g., complexity of the training handle sets118. Further, and as also detailed below, training the handle processormodel 110 can involve supervision implemented by varying a chamferdistance between SDF representations of the training handle sets 118 andthe generated handle sets 126, respectively.

FIG. 3 b depicts a system 300 b for incorporating handle accuracyprediction into the handle processor model 110. The system 300 b, forinstance, represents a variation and/or extension of the system 300 a.In the system 300 b, an accuracy predictor module 310 is incorporatedinto the handle processor model 110. The accuracy predictor module 310,for instance, is representative of a branch of the decoder module 308that is configured to predict whether handles generated by the handleprocessor model 110 meet a probability threshold such that the handlesare to be kept or discarded.

Further to the system 300 b, after the decoder module 308 is trainedusing the handle SDFs 302, the accuracy predictor module 310 is trained.For instance, in a first pass such as described with reference to thesystem 300 a, the decoder module 308 generates initial handles 312 thatrepresent parametric representations of handles output from the decodermodule 308. The initial handles 312 are then transformed into the handleSDFs 302 (such as described below), and utilized to train the accuracypredictor module 310. For instance, latent representation 306 generatedby the encoder module 304 based on the initial handles 312 are input tothe accuracy predictor module 310, which decodes the latentrepresentation 306 and generates predicted handles 314. Generally, eachhandle of the predicted handles 314 is associated with a probabilityvalue 316. Predicted handles 314 with a probability value 316 below athreshold probability value are discarded, as represented by removedhandles 318. The remaining predicted handles 314 correspond to thegenerated handle sets 126. Thus, the system 300 b is operable to removeinaccurately predicted handles and thus provide for accurate predictionof shape parameters.

FIG. 4 depicts a system 400 for generating the handle SDFs 302. Depictedas part of the system 400 is a training shape 116 composed of a traininghandle set 118. In this particular example, the training handle set 118includes multiple handles 402 that combine to form the training shape116. Examples of the handles 402 include a handle 402 a, a handle 402 b,. . . , and a handle 402 n. In this particular example, the handles 402a-402 n represent different cuboids that make up portions of thetraining shape 116. Further, the handles 402 each include differenthandle parameters 404 that describe attributes of each handle 402, suchas geometric and/or visual attributes. Examples of the handle parameters404 include parametric representations of each handle 402, such ashandle size (e.g., length, width, height), handle center location,handle rotation, and so forth.

Further to the system 400, the handles 402 are input to an SDF generatormodule 406 of the object editor module 108, which processes the handleparameters 404 to generate the handle SDFs 302. Example ways forgenerating the handle SDFs 302 based on the handle parameters 404 arediscussed below.

FIG. 5 depicts a system 500 describing example aspects of generating anSDF based on handle parameters. The system 500 includes a handle 502,which represents an instance of a training handle 118 and/or a generatedhandle 126. Further, the handle 502 includes handle parameters 504,which indicate a handle length of 5 (S_(x)=5), a handle width of 1(S_(y)=1), and a handle rotation value of 0, e.g., R=0.

Continuing, the SDF generator module 406 processes the handle parameters504 to generate a handle SDF 302 that represents an SDF representationof the handle parameters 404. In at least one implementation, the SDFgenerator module 406 generates the handle SDF 302 using a signeddistance function computed in a coarse regular grid. For instance, thehandle SDF 302 can be generated as a grid with 8³ cells, e.g., a gridwith 256 dimensions. The handle SDF 302 can then be “flattened” togenerate a flattened SDF 506 that is utilized to train the handleprocessor model 110, and to utilize the trained handle processor model110 to perform various shape related tasks.

FIG. 6 depicts a system 600 for shape generation. In the system 600, thetraining shapes 116 are utilized to train the handle processor model110. Further, a sampling instruction 602 is input to the object editormodule 108, and the object editor module 108 leverages the trainedhandle processor model 110 to generate sampled shapes 604. The sampledshapes 604, for instance, represent shapes generated by the trainedhandle processor model 110 by sampling different values from z valuesobtained from the latent representation 306, and generating shapes basedon the sampled z values.

FIG. 7 depicts a system 700 for generating shapes via interpolation. Inthe system 700, the training shapes 116 are utilized to train the handleprocessor model 110. Further, an interpolation instruction 702 is inputto the object editor module 108, and the object editor module 108leverages the trained handle processor model 110 to generateinterpolated shapes 704. The object editor module 108, for instance,leverages the trained handle processor model 110 to linearly interpolatedifferent z values obtained from the latent representation 306, and togenerate the interpolated shapes 704 based on the linear interpolations.

FIG. 8 depicts a system 800 for generating shapes via shape completion.In the system 800, different sets of input handles (e.g., including atleast one handle) are input to the object editor module 108, whichleverages the handle processor model 110 to generate different shapesfrom the input handles. For instance, input handles 802 a are input tothe object editor module 108, which leverages the handle processor model110 to generate an output shape 804 a based on the input handles 802 a.In another example, input handles 802 b are input to the object editormodule 108, which leverages the handle processor model 110 to generatean output shape 804 b based on the input handles 802 b. In at least someimplementations, and as further detailed below, the output shapes 804 a,804 b can be generated by utilizing the handle processor model 110 toapply a gradient descent algorithm to the input handles 802 a, 802 b togenerate the output shapes 804 a, 804 b, respectively. Generally, theoutput shapes 804 a, 804 b represent larger sets of handles than theinput handles 802 a, 802 b, and in at least some implementations can beconsidered “complete shapes” that are completed based on the inputhandles 802 a, 802 b according to salient shape properties representedin the latent representation 306.

FIG. 9 depicts a system 900 for generating shapes of differentcomplexity via shape completion. In the system 900, input handles 902are input to the object editor module 108, which leverages the handleprocessor model 110 to generate different shapes from the input handles.For instance, by utilizing the accuracy predictor module 310, acomplexity module 904 can be introduced and manipulated to generateoutput shapes of differing complexity. In at least one implementation,the complexity module 904 represents a parsimony regularizer, operationof which is detailed below. By manipulating operational values of thecomplexity module 904, an output shape 906 a and an output shape 906 bare generated and output by the object editor module 108. Notice thatthe output shape 906 b includes more handles than the output shape 906a, and thus the output shapes 906 a, 906 b different from each other inhandle complexity.

FIG. 10 depicts a system 1000 for generating shapes of with differenthandle types. In the system 1000, the training shapes 116 are utilizedto train the handle processor model 110. Further, a shape generationinstruction 1002 is input to the object editor module 108, and theobject editor module 108 leverages the trained handle processor model110 to generate output shapes 1004 that are comprised of different typesof handles. For instance, output shapes 1004 a, 1004 b are made up ofellipsoid handles, and an output shape 1004 c is made up of cuboidhandles. Further, an output shape 1004 d is made up of both cuboid andellipsoid handles. For instance, the output shape 1004 d includesellipsoid handles 1006 a, 1006 b, and cuboid handles 1006 c, 1006 d, and1006 e. In at least one implementation, by utilizing SDF representationsof handles as part of the training handle sets 118, different handletypes can be represented and utilized as part of shape generation. Forinstance, handle shapes that are capable of being represented as an SDF(e.g., cuboids, ellipsoids, and so forth) can be utilized as part of thetraining handle sets 118 such that the handle processor model 110 cangenerate shapes with different handle types. In at least oneimplementation, and as detailed below, a particular loss functionutilized as part of the handle processor model 110 enables variation inhandle type.

Having discussed example details of the techniques for generative shapecreation and editing, consider now some example procedures to illustrateadditional aspects of the techniques.

Example Procedures

This section describes example procedures for generative shape creationand editing in one or more implementations. Aspects of the proceduresmay be implemented in hardware, firmware, or software, or a combinationthereof. The procedures are shown as a set of blocks that specifyoperations performed by one or more devices and are not necessarilylimited to the orders shown for performing the operations by therespective blocks. In at least some implementations the procedures areperformed by a suitably configured device, such as via the object editorsystem 102 of FIG. 1 that makes use of the object editor module 108 andusing aspects described in the scenarios above.

FIG. 11 depicts an example procedure 1100 for generating shapes. Step1102 receives a set of shapes that are each made up of sets of visualelements. The object editor module 108, for instance, receives as inputthe training shapes 116 including the training handle sets 118. In atleast one implementation, a user interacts with the editor GUI 130 tocause the training shapes 116 to be input to the object editor system102 as part of initiating a shape generation process.

Step 1104 transforms each set of visual elements into distance fieldrepresentations of each visual element in each set of visual elements.The SDF generator module 406, for example, processes parameters for eachhandle in a handle training set 118 to generate the handle SDFs 302.Generally, this includes representing the handle parameters in cells ofa fixed 3D grid, and computing the distance of each grid cell to thehandle. As mentioned above, for instance, using a grid with 8³ cellsresults in 256 dimensions and thus would result in 256 SDF values. Thesevalues are “flattened” in a vector representation, e.g., the signeddistance of a top left grid cell becomes a first element in the vector,and so on, until all of the SDF values are represented in the vectorrepresentation.

Step 1106 generates a latent representation of the set of shapes basedon the distance field representations. The encoder module 304, forinstance, processes the handle SDFs 302 as part of the training thehandle processor model 110, and then generates the latent representation306.

Initially, to train the handle processor model 110, the object editormodule 108 defines a chamfer distance between two handle sets A and B,where A corresponds to a training handle set from the training handlesets 118, and B corresponds to a generated handle set from the generatedhandle sets 126. The chamfer distance can be calculated as:

$\begin{matrix}{{{Ch}( {A,B} )} = {\frac{1}{❘A❘}{\sum\limits_{a \in B}{\underset{b \in B}{\min}{D( {a,b} )}}}}} & {{Equation}1}\end{matrix}$

Generally, (a, b) represent individual handles from each handle set A,B, respectively, and D(a, b) is a distance between elements in therespective sets. Further, in an implementation where the respectivehandles in the handle sets are represented as values of respective SDFsevaluated in a coarse regular grid, D(a, b) represents an L2 distance(e.g., a Euclidean distance) between a and b.

Accordingly, training the handle processor model 110 includes solvingthe following equation, such as through stochastic gradient descent:

$\begin{matrix}{\underset{\theta}{\arg\min}{{\mathbb{E}}_{X \sim D}\lbrack {{\frac{1}{❘{f_{\theta}(X)}❘}{\sum\limits_{\alpha \in {f_{\theta}(X)}}{\min\limits_{x \in X}{{x - a}}_{2}^{2}}}} + {\frac{1}{❘X❘}{\sum\limits_{x \in X}{\min\limits_{a \in {f_{\theta}(X)}}{{x - a}}_{2}^{2}}}}} \rbrack}} & {{Equation}2}\end{matrix}$

In Equation 2, f_(a) represents the handle processor model 110 (e.g.,the encoder module 304 and/or the decoder module 308), X representssample SDFs from the training handle set 118 (e.g., the handle SDFs302), and x represents individual elements from the sample SDFs.Accordingly, solving Equation 2 generates the latent representation 306,e.g., the z variable as used throughout.

As referenced above, implementations can enable multiple differenthandle types to be utilized for shape generation. An example way forenabling multiple handle types is by adding a term in the loss functionthat attempts to match the handle type of a generated handle with alabeled handle type of the training handle sets 118, such as identifiedby the training labels 120. The modified loss term can be defined as:

$\begin{matrix}{{\mathcal{L}_{C}( {A,B} )} = {\frac{1}{❘B❘}{\sum\limits_{b \in B}{H( {{C( {\underset{a \in A}{\arg\min}{{a - b}}_{2}^{2}} )},{C(b)}} )}}}} & {{Equation}3}\end{matrix}$

In Equation 3, H is a cross-entropy function and C is a function thatreturns the label of a generated handle. In at least one implementation,C is not an additional function, but is parametrized by the handleprocessor model 110 by modifying the term to generate an extra one-hotencoding per handle. Further, C(b) is determined from the traininglabels 120.

Step 1108 decodes the latent representation to generate a set of decodedvisual elements that are each comprised of a set of parameters thatdescribe geometric aspects of each decoded visual element. The decodermodule 308, for instance, decodes the latent representation 306 togenerate the generated handle sets 126. In at least one implementation,decoding the latent representation 306 includes converting SDFsrepresented in the latent representation 306 into corresponding handleparameters, e.g., parameters that define the generated handle sets 126.

Implementations can utilize existence prediction to enable inaccuratelygenerated handles to be filtered out, e.g., removed. Accordingly, step1110 predicts an accuracy probability for each decoded visual element.The accuracy predictor module 310, for instance, processes each initialhandle 312 generated by the decoder module 308 to determine aprobability value for each initial handle 312. In at least one example,the probability for each initial handle 312 is calculated by trainingthe accuracy predictor module 310 to predict a probability value P(a)for each initial handle 312. Generally, this includes incorporating P(a)into the loss function (described above with reference to Equations 1-3)utilized by the handle processor model 110. For instance, thebidirectional chamfer distance between two sets of the predicted handles314 is rewritten in a probabilistic manner as:

ℒ ⁡ ( A , B ) = a ∼ A [ min b ∈ B  a - b  2 2 ] + b ∼ B [ min a ∈ A a - b  2 2 ] Equation ⁢ 4   

Each of these terms can be calculated as:

a ∼ A [ min b ∈ B  a - b  2 2 ] = ∑ a ∈ A P ⁡ ( a ) min b ∈ B  a - b 2 2 Equation ⁢ 5

b ∼ B [ min a ∈ A  a - b  2 2 ] = ∑ b ∈ B ∑ i = 1 i = ❘"\[LeftBracketingBar]" A ❘ "\[RightBracketingBar]" P ⁡ ( a i ) ⁢  a i - b 2 2 ⁢ ∏ i = 1 j = i ( 1 - P ⁡ ( a i ) ) Equation ⁢ 6

Generally, a_(i) represents an i-th handle sorted according to itsdistance to b. Further,

(A,B) is used to train the accuracy predictor module 310 to predict P(a)while keeping the predicted parameters (e.g., geometric parameters) ofthe handles constant. This training process, for instance, trains theaccuracy predictor module 310 to filter out inaccurately predictedhandles. For instance, P(a) will be smaller (e.g., below a probabilitythreshold) for handles that have a larger contribution to a loss, e.g.,inaccurately predicted handles. Further, removing an accuratelypredicted handle will increase the loss, thus indicating that a handleis accurate. In at least one implementation, the distance betweenelements (a, b) in the sets is the sum of squared differences betweenthe calculated SDF for the respective elements.

Step 1112 removes at least one decoded visual element by determiningthat an accuracy probability for the at least one decoded visual elementis below an accuracy probability threshold. For instance, the accuracypredictor module 310 determines that an accuracy probability for thedecoded visual element is below a specified accuracy threshold, such asbased on determining that a loss contribution of the decoded visualelement exceeds a threshold loss.

Step 1114 generates a generated shape utilizing the decoded visualelements and based the set of parameters for each decoded visualelement. The object editor module 108, for instance, generates agenerated shape 124 utilizing handles generated by the handle processormodel 110, e.g., a generated handle set 126 output by the decoder module308. In implementations that utilize accuracy prediction, handles thatare indicated as inaccurately predicted and thus removed are notutilized to generate the shape. Generally, a shape may be generated inaccordance with various shape generation scenarios, such as describedabove for shape sampling (e.g., the system 600), shape interpolation(e.g., the system 700), and shape completion, e.g., the systems 800,900. Further, a generated shape can be displayed on the display device132 of the client device 104, such as to enable further editing of thegenerated shape via interaction with the object editor system 102.

FIG. 12 depicts an example procedure 1200 for shape completion. Step1202 receives input of a set of visual elements. A user, for instance,interacts with the editor GUI 130 to cause a set of handles to be inputto the object editor system 102. Generally, the handles can be input invarious ways, such as via selection of a set of pre-generated handles, auser drawing a handle set via the object editor module 108, a userselection of a set of preconfigured shapes, and so forth.

Step 1204 processes the input set of visual elements to build a shapebased on the input set of visual elements. An input set of handles, forinstance, is input to the handle processor model 110, which processesthe input handles to generate an output shape that augments the inputhandles with additional handles to generate a “completed” shape.Generally, the object editor module 108 can leverage the handleprocessor model 110 to automatically generate a completed shape based ona small subset of input handles.

In at least one implementation, building a shape based on the input setof handles involves utilizing the latent representation 306 (e.g., the zvariable) the complete the input handles via gradient descent. Forinstance, consider the following:

$\begin{matrix}{z^{*} = {\underset{z}{\arg\min}{{Ch}( {{f_{\theta}(z)},A^{\prime}} )}}} & {{Equation}7}\end{matrix}$

In Equation 7, f_(θ) represents the handle processor model 110 (e.g.,the decoder module 308), and A′ represents the input set of handles,e.g., the input handles 802, 902. Accordingly, a “completed” shape canbe characterized as f_(θ)(z*).

As mentioned above with reference to the system 900, techniques can beemployed to complete shapes of different complexity, e.g., completedshapes with differing numbers of handles. To control shape complexity,the accuracy predictor module 310 can be leveraged to introduce aparsimony component to generate sets of handles with differingcomplexity for shape completion, such as based on the followingoptimization:

z * = arg ⁢ min z ⁢ Ch ⁢ ( f θ ⁢ ( z ) , A ′ ) + λ ⁢ a i ∼ f θ ( z ) [ g ϕ (z ) a i ] Equation ⁢ 8

In at least one implementation, Equation 8 can be leveraged to implementthe complexity module 904 discussed with reference to the system 900.For instance, Equation 8 represents a parsimony regularizer, and thevalue of λ can be manipulated to vary the complexity of a completedshape. In at least one implementation, represents a complexity variablethat can be manipulated to affect the complexity of a generated shape.In the system 900, for example, the output shape 906 a is based on λ=10,and the output shape 906 b is based on λ=0. In at least oneimplementation, a user can interact with the editor GUI 130 to inputdifferent λ values to enable shape completion using different handlecomplexities.

FIG. 13 depicts an example procedure 1300 for shape editing. Forinstance, after a shape is generated as described above, a user mayinteract with the object editor module 108 to edit the shape. In atleast one implementation, shape editing includes user manipulation ofhandles that make up the shape.

Step 1302 receives an input interaction to manipulate a visual elementof a shape. A user, for instance, interacts with the object editorsystem 102 to manipulate a handle included as part of a shape, such as agenerated shape 124. Generally, the manipulation can take various forms,such as user input to resize a handle, change a handle shape, and/or tomove a handle, such as through translational movement, rotationalmovement, and so forth.

Step 1304 processes the manipulated visual element to adjust themanipulated visual element to a defined shape manifold for the shape.The shape manifold, for instance, is based on the latent representation306, which defines a set of plausible handle configurations. Thus, in ascenario where a user manipulates a handle such that parameters of thehandle (e.g., position, size, and/or shape) do not conform to the latentrepresentation 306, the object editor module 108 can reposition and/orresize the manipulated handle to conform to the latent representation306.

In at least one implementation, the object editor module 108 adjusts themanipulated handle via backpropagation of the shape with the manipulatedhandle through the trained decoder module 308. For instance, the decodermodule 308 compares parameters of the manipulated handle to the latentrepresentation 306, and causes parameters of the manipulated handle tobe adjusted to conform to shape parameters represented by the latentrepresentation 306.

Step 1306 generates an edited shape based on the adjusted visualelement. The object editor module 108, for example, generates a newshape that reflects the original shape as modified by the usermanipulation of the handle and the adjusted handle as adjusted by thehandle processor model 110.

Accordingly, the described techniques can be employed to enable shapeediting that adjusts edited shapes based on salient features of shapesused for training, such as the latent representation 306 generated fromthe training shapes 116.

Having described example procedures in accordance with one or moreimplementations, consider now an example system and device that can beutilized to implement the various techniques described herein.

Example System and Device

FIG. 14 illustrates an example system generally at 1400 that includes anexample computing device 1402 that is representative of one or morecomputing systems and/or devices that may implement the varioustechniques described herein. This is illustrated through inclusion ofthe object editor module 108. The computing device 1402 may be, forexample, a server of a service provider, a device associated with aclient (e.g., a client device), an on-chip system, and/or any othersuitable computing device or computing system.

The example computing device 1402 as illustrated includes a processingsystem 1404, one or more computer-readable media 1406, and one or moreI/O interfaces 1408 that are communicatively coupled, one to another.Although not shown, the computing device 1402 may further include asystem bus or other data and command transfer system that couples thevarious components, one to another. A system bus can include any one orcombination of different bus structures, such as a memory bus or memorycontroller, a peripheral bus, a universal serial bus, and/or a processoror local bus that utilizes any of a variety of bus architectures. Avariety of other examples are also contemplated, such as control anddata lines.

The processing system 1404 is representative of functionality to performone or more operations using hardware. Accordingly, the processingsystem 1404 is illustrated as including hardware elements 1410 that maybe configured as processors, functional blocks, and so forth. This mayinclude implementation in hardware as an application specific integratedcircuit or other logic device formed using one or more semiconductors.The hardware elements 1410 are not limited by the materials from whichthey are formed or the processing mechanisms employed therein. Forexample, processors may be comprised of semiconductor(s) and/ortransistors (e.g., electronic integrated circuits (ICs)). In such acontext, processor-executable instructions may beelectronically-executable instructions.

The computer-readable storage media 1406 is illustrated as includingmemory/storage 1412. The memory/storage 1412 represents memory/storagecapacity associated with one or more computer-readable media. Thememory/storage component 1412 may include volatile media (such as randomaccess memory (RANI)) and/or nonvolatile media (such as read only memory(ROM), Flash memory, optical disks, magnetic disks, and so forth). Thememory/storage component 1412 may include fixed media (e.g., RAM, ROM, afixed hard drive, and so on) as well as removable media (e.g., Flashmemory, a removable hard drive, an optical disc, and so forth). Thecomputer-readable media 1406 may be configured in a variety of otherways as further described below.

Input/output interface(s) 1408 are representative of functionality toallow a user to enter commands and information to computing device 1402,and also allow information to be presented to the user and/or othercomponents or devices using various input/output devices. Examples ofinput devices include a keyboard, a cursor control device (e.g., amouse), a microphone, a scanner, touch functionality (e.g., capacitiveor other sensors that are configured to detect physical touch), a camera(e.g., which may employ visible or non-visible wavelengths such asinfrared frequencies to recognize movement as gestures that do notinvolve touch), and so forth. Examples of output devices include adisplay device (e.g., a monitor or projector), speakers, a printer, anetwork card, tactile-response device, and so forth. Thus, the computingdevice 1402 may be configured in a variety of ways as further describedbelow to support user interaction.

Various techniques may be described herein in the general context ofsoftware, hardware elements, or program modules. Generally, such modulesinclude routines, programs, objects, elements, components, datastructures, and so forth that perform particular tasks or implementparticular abstract data types. The terms “module,” “functionality,” and“component” as used herein generally represent software, firmware,hardware, or a combination thereof. The features of the techniquesdescribed herein are platform-independent, meaning that the techniquesmay be implemented on a variety of commercial computing platforms havinga variety of processors.

An implementation of the described modules and techniques may be storedon or transmitted across some form of computer-readable media. Thecomputer-readable media may include a variety of media that may beaccessed by the computing device 1402. By way of example, and notlimitation, computer-readable media may include “computer-readablestorage media” and “computer-readable signal media.”

“Computer-readable storage media” may refer to media and/or devices thatenable persistent and/or non-transitory storage of information incontrast to mere signal transmission, carrier waves, or signals per se.Computer-readable storage media do not include signals per se ortransitory signals. The computer-readable storage media includeshardware such as volatile and non-volatile, removable and non-removablemedia and/or storage devices implemented in a method or technologysuitable for storage of information such as computer readableinstructions, data structures, program modules, logic elements/circuits,or other data. Examples of computer-readable storage media may include,but are not limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disks (DVD) or other opticalstorage, hard disks, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or other storage device,tangible media, or article of manufacture suitable to store the desiredinformation and which may be accessed by a computer.

“Computer-readable signal media” may refer to a signal-bearing mediumthat is configured to transmit instructions to the hardware of thecomputing device 1402, such as via a network. Signal media typically mayembody computer readable instructions, data structures, program modules,or other data in a modulated data signal, such as carrier waves, datasignals, or other transport mechanism. Signal media also include anyinformation delivery media. The term “modulated data signal” means asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in the signal. By way of example,and not limitation, communication media include wired media such as awired network or direct-wired connection, and wireless media such asacoustic, RF, infrared, and other wireless media.

As previously described, hardware elements 1410 and computer-readablemedia 1406 are representative of modules, programmable device logicand/or fixed device logic implemented in a hardware form that may beemployed in some embodiments to implement at least some aspects of thetechniques described herein, such as to perform one or moreinstructions. Hardware may include components of an integrated circuitor on-chip system, an application-specific integrated circuit (ASIC), afield-programmable gate array (FPGA), a complex programmable logicdevice (CPLD), and other implementations in silicon or other hardware.In this context, hardware may operate as a processing device thatperforms program tasks defined by instructions and/or logic embodied bythe hardware as well as a hardware utilized to store instructions forexecution, e.g., the computer-readable storage media describedpreviously.

Combinations of the foregoing may also be employed to implement varioustechniques described herein. Accordingly, software, hardware, orexecutable modules may be implemented as one or more instructions and/orlogic embodied on some form of computer-readable storage media and/or byone or more hardware elements 1410. The computing device 1402 may beconfigured to implement particular instructions and/or functionscorresponding to the software and/or hardware modules. Accordingly,implementation of a module that is executable by the computing device1402 as software may be achieved at least partially in hardware, e.g.,through use of computer-readable storage media and/or hardware elements1410 of the processing system 1404. The instructions and/or functionsmay be executable/operable by one or more articles of manufacture (forexample, one or more computing devices 1402 and/or processing systems1404) to implement techniques, modules, and examples described herein.

The techniques described herein may be supported by variousconfigurations of the computing device 1402 and are not limited to thespecific examples of the techniques described herein. This functionalitymay also be implemented all or in part through use of a distributedsystem, such as over a “cloud” 1414 via a platform 1416 as describedbelow.

The cloud 1414 includes and/or is representative of a platform 1416 forresources 1418. The platform 1416 abstracts underlying functionality ofhardware (e.g., servers) and software resources of the cloud 1414. Theresources 1418 may include applications and/or data that can be utilizedwhile computer processing is executed on servers that are remote fromthe computing device 1402. Resources 1418 can also include servicesprovided over the Internet and/or through a subscriber network, such asa cellular or Wi-Fi network.

The platform 1416 may abstract resources and functions to connect thecomputing device 1402 with other computing devices. The platform 1416may also serve to abstract scaling of resources to provide acorresponding level of scale to encountered demand for the resources1418 that are implemented via the platform 1416. Accordingly, in aninterconnected device embodiment, implementation of functionalitydescribed herein may be distributed throughout the system 1400. Forexample, the functionality may be implemented in part on the computingdevice 1402 as well as via the platform 1416 that abstracts thefunctionality of the cloud 1414.

CONCLUSION

Although the invention has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the invention defined in the appended claims is not necessarilylimited to the specific features or acts described. Rather, the specificfeatures and acts are disclosed as example forms of implementing theclaimed invention.

What is claimed is:
 1. A method implemented by a processing device, themethod comprising: encoding a first set of visual elements by:reconstructing the first set of visual elements to represent a manifoldthat describes configurations of the first set of visual elements;transforming the first set of visual elements into signed distance fieldrepresentations of geometric relations between visual elements of thefirst set of visual elements based on the manifold by: representing thevisual elements in cells of a 3D grid; and computing a distance of eachgrid cell to a visual element; and generating a latent representation bya machine learning model using the signed distance fieldrepresentations; decoding the latent representation by samplingdifferent values from the latent representation to generate a set ofdecoded visual elements and parametric representations describingaspects of individual decoded visual elements of the set of decodedvisual elements; calculating an accuracy probability for the individualdecoded visual elements of the set of decoded visual elements; removinga particular decoded visual element based on determining that anaccuracy probability for the particular decoded visual element is belowa threshold accuracy probability; and generating a shape utilizingremaining decoded visual elements and based on the parametricrepresentations describing aspects of the set of decoded visualelements.
 2. A method as described in claim 1, wherein generating thelatent representation includes encoding the signed distance fieldrepresentations.
 3. A method as described in claim 1, wherein saiddecoding comprises decoding the latent representation based on acomplexity variable to generate the set of decoded visual elements toinclude more visual elements than the first set of visual elements.
 4. Amethod as described in claim 3, wherein the complexity variable is userspecified.
 5. A method as described in claim 3, wherein the complexityvariable specifies a number of visual elements to be included in thedecoded visual elements.
 6. A method as described in claim 1, whereinsaid calculating an accuracy probability for individual decoded visualelements is performed by an additional machine learning model andcomprises configuring a bidirectional chamfer distance of a lossfunction to enable the additional machine learning model to calculatethe accuracy probability based on evaluation of the loss functionincluding individual decoded visual elements.
 7. A method as describedin claim 1, wherein said decoding is performed by a decoder module thatis trained using the first set of visual elements to generate the set ofdecoded visual elements, and wherein said calculating an accuracyprobability is performed by an accuracy predictor module that is trainedusing the set of decoded visual elements to perform said calculating theaccuracy probability.
 8. A method as described in claim 1, furthercomprising: receiving an input interaction to manipulate a visualelement of the generated shape; processing the manipulated visualelement to adjust the manipulated visual element to a defined shapemanifold for the generated shape, wherein the shape manifold is based onthe latent representation; and generating an edited shape based on theadjustment to the manipulated visual element.
 9. A method implemented bya processing device, the method comprising: encoding a set of visualelements by: reconstructing the set of visual elements to represent amanifold that describes configurations of the set of visual elements;transforming the set of visual elements into signed distance fieldrepresentations of geometric relations between visual elements of theset of visual elements based on the manifold by: representing the visualelements in cells of a 3D grid; and computing a distance of each gridcell to a visual element; and generating a latent representation by amachine learning model using the signed distance field representations;decoding the latent representation by sampling different values from thelatent representation to generate a set of decoded visual elements andparametric representations describing aspects of individual decodedvisual elements of the set of decoded visual elements; generating ashape utilizing the decoded visual elements and based on the parametricrepresentations describing aspects of the set of decoded visualelements; receiving an input interaction to manipulate a visual elementof the generated shape; processing the manipulated visual element toadjust the manipulated visual element to a defined shape manifold forthe generated shape, wherein the shape manifold is based on the latentrepresentation; and generating an edited shape based on the adjustmentto the manipulated visual element.
 10. A method as described in claim 9,further comprising encoding the signed distance field representations togenerate the latent representation.
 11. A method as described in claim9, wherein said decoding comprises decoding the latent representationbased on a complexity variable to generate the set of decoded visualelements to include more visual elements than the set of visualelements.
 12. A method as described in claim 11, wherein said receivingan input interaction to manipulate a visual element is based on a userinput to a graphical user interface, and where the complexity variableis determined based on a different user input to the graphical userinterface to specify the complexity variable.
 13. A method as describedin claim 9, further comprising: calculating an accuracy probability forindividual decoded visual elements of the set of decoded visualelements; and removing a particular decoded visual element based ondetermining that an accuracy probability for the particular decodedvisual element is below a threshold accuracy probability, wherein saidgenerating a shape utilizes remaining decoded visual elements.
 14. Amethod as described in claim 9, wherein the shape manifold comprises atopological space that defines different configurations of decodedvisual elements according to the latent representation.
 15. A method asdescribed in claim 9, wherein said processing the manipulated visualelement to adjust the manipulated visual element comprises one or moreof automatically repositioning or resizing the visual element to conformto the latent representation.
 16. A system comprising: an encoder moduleimplemented at least partially in hardware of at least one processingdevice to encode a first set of visual elements by: reconstructing thefirst set of visual elements to represent a manifold that describesconfigurations of the first set of visual elements; transforming thefirst set of visual elements into signed distance field representationsof geometric relations between visual elements of the first set ofvisual elements based on the manifold by: representing the visualelements in cells of a 3D grid; and computing a distance of each gridcell to a visual element; generating a latent representation by amachine learning model using the signed distance field representations;a decoder module implemented at least partially in the hardware of theat least one processing device to decode the latent representation bysampling different values from the latent representation and based on acomplexity variable to generate a set of decoded visual elements andparametric representations describing aspects of individual decodedvisual elements of the set of decoded visual elements, that includesmore visual elements than the first set of visual elements; and anobject editor module implemented at least partially in the hardware ofthe at least one processing device to generate a shape utilizing the setof decoded visual elements and based on the parametric representationsdescribing aspects of the set of decoded visual elements.
 17. A systemas described in claim 16, wherein the decoder module is implemented toreceive the complexity variable as a value received via user input. 18.A system as described in claim 16, further comprising an accuracypredictor module implemented at least partially in the hardware of theat least one processing device to: calculate an accuracy probability forindividual decoded visual elements of the set of decoded visualelements; and remove a particular decoded visual element based ondetermining that an accuracy probability for the particular decodedvisual element is below a threshold accuracy probability.
 19. A systemas described in claim 18, wherein the decoder module is trained usingthe first set of visual elements to generate the set of decoded visualelements, and wherein the accuracy predictor module is trained using theset of decoded visual elements to calculate the accuracy probability.20. A system as described in claim 16, further comprising an objecteditor module implemented at least partially in the hardware of the atleast one processing device to receive an input interaction tomanipulate a visual element of the generated shape, and wherein thedecoder module is further implemented to adjust the manipulated visualelement to a defined shape manifold for the generated shape, wherein theshape manifold is based on the latent representation.